The Jackknife in Classification
نویسنده
چکیده
Breiman (1996), in an important contribution to the eld of classi cation, introduced the notion of resampling for improving classi cation rules. Freund and Schapire (1996) developed an other algorithm that exploits the resampling. This paper presents a Jackknife-type approach combined with the Freund and Schapire (FS) method. We propose and explore some alternatives to this algorithm and nd that it is possible to get a quality as good or better than the results obtained with Breiman's or the FS method with less computation, and that there exists an evolution of the quality of the results depending on a parameter we introduce in our method.
منابع مشابه
A Jackknife and Voting Classifier Approach to Feature Selection and Classification
With technological advances now allowing measurement of thousands of genes, proteins and metabolites, researchers are using this information to develop diagnostic and prognostic tests and discern the biological pathways underlying diseases. Often, an investigator's objective is to develop a classification rule to predict group membership of unknown samples based on a small set of features and t...
متن کاملThe Effect of Nonresponse Primary Sampling Units on Estimating the Variance of Changes by Jackknife Method (Case Study: Labor Force Survey Data for 2009 and 2010)
Abstract. According to the importance of presenting change estimation of labor force survey indicators along with their variance, in this paper, the use of Jackknife method in estimating variance of changes has been investigated. Then, the effect of nonresponse primary sampling units on estimating the variance of changes has been studied by use of Jackknife method via intensive simulation stud...
متن کاملOn Jackknifing Kernel Regression Function
"Estimation of the value of a regression function at a point of continuity using a kernel-type estimator is discussed and improvements of the technique by a generalized jackknife estimator are presented. It is shown that the generalized jackknife technique produces estimators with faster bias rates. In a small example it is investigated, if the generalized jackknife method works for all choices...
متن کاملSome Invariance Principles Relating to Jackknifing and Their Role in Sequential Analysis
For a broad class of jackknife statistics, it is shown that the Tukey estimator of the variance converges almost surely to its population counterpart. Moreover, the usual invariance principles (relating to the Wiener process approximations) usually filter through jackknifing under no extra regularity conditions. These results are then incorporated in providing a bounded-length (sequential) conf...
متن کاملRoc Analysis in Machine Learning Program Committee Organising Committee Table of Contents Resampling Methods for the Area under the Roc Curve
Receiver Operating Characteristic (ROC) analysis is a common tool for assessing the performance of various classification tools including biological markers, diagnostic tests, technologies or practices and statistical models. ROC analysis gained popularity in many fields including diagnostic medicine, quality control, human perception studies and machine learning. The area under the ROC curve (...
متن کاملEvaluation of Jackknife and Bootstrap for Defining Confidence Intervals for Pairwise Agreement Measures
Several research fields frequently deal with the analysis of diverse classification results of the same entities. This should imply an objective detection of overlaps and divergences between the formed clusters. The congruence between classifications can be quantified by clustering agreement measures, including pairwise agreement measures. Several measures have been proposed and the importance ...
متن کامل